• 



Attorney Docket No. INT1P208 



APPLICATION FOR UNITED STATES PATENT 



EFFICIENT COMPUTATION OF LOG-FREOUENCY-SCALE DIGITAL 



FILTER CASCADE 



By Inventors: 

Lloyd Watts 
500 Chiquita Ave., Apt. 14 
Mountain View, CA 94041 
A Citizen of Canada 



Assignee: Interval Research Corporation 
Stattis: Small Entity 



RITTER, VAN PELT AND YI, LLP 
4906 El Camino Real Suite 205 
Los Altos, CA 94022 
Telephone (650) 903-3500 



EFFICIENT COMPUTATION OF LOG-FREQUENCY-SCALE 



DIGITAL FILTER CASCADE 



FIELD OF THE INVENTION 



This invention relates generally to a method, article of manufacture, and apparatus for 
computing the response of a cascade of digital filters in an efficient manner that provides for 
high resolution while reducing computational expense and storage requirements. More 
particularly, this invention relates to modeling a cochlea for real-time processing of acoustic 
signals using an improved digital filter bank cascade. 



Much effort has been devoted to modeling hearing, for applications such as automatic 
speech recognition, noise cancellation, hearing aids, and music. A popular approach is to 
model the cochlea, a coiled snail-shaped structure that is part of the inner ear as shown in 
FIG. 1 . The cochlea is a spiraling, fluid-filled tunnel embedded in the temporal bone, and 
converts acoustic signals into electrical signals transmitted to the brain. Sound pressure 
waves strike the eardrum, causing it to move inward and moving the three small bones of the 
middle ear, which are the hammer, anvil, and stirrup. The movement of the bones initiates 
pressure waves in the cochlear fluid. These pressure waves propagate along the cochlear 
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partition, which, as shown in FIG. 2, consists of the basilar membrane BM, tectorial 
membrane TM, and organ of Corti OC. The organ of Corti OC is a collection of cells, 
including the sensory hair cells, that sit on the basilar membrane BM. The bases (bottoms) of 
these hair cells are connected to nerve fibers NF fi-om the auditory nerve AN, and the apexes 
(tops) of the hair cells have hair bundles HB. There are two types of hair cells in the cochlea: 
inner hair cells EHC and outer hair cells OHC. 

The human cochlea is believed to contain approximately 4,000 inner hair cells EHC 
and 12,000 outer hair cells OHC, with four cells radially abreast and spaced every 10 microns 
along the length of the basilar membrane BM. The tectorial membrane TM lies on top of the 
surface of the organ of Corti OC. A thin fluid space of about 4 to 6 microns lies between 
these two surfaces, which shear as the basilar membrane BM moves up and down. The hair 
cells are primarily transducers that convert displacement of the hair bundle HB (due to 
shearing between the tectorial membrane TM and the surface of the organ of Corti) into a 
change in the receptor current flowing through the cell, which is transmitted to the auditory 
nerve AN and processed by the brain. 

Each point on the basilar membrane BM is tuned to a different fi*equency, with a 
spatial gradient of about 0.2 octaves/mm for a human, and about 0.32 octaves/mm for a cat. 
Roughly speaking, the cochlea acts like a bank of filters. The filtering allows the separation 
of various fi"equency components of the signal with a good signal-to-noise ratio. The range 
of audible fi-equencies is about 20 Hz to 16 kHz in the human cochlea and about 100 Hz to 
40kHz in the cat cochlea. 
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Modeling the function of the cochlea has been an active area of research for many 
years. For example, U.S. Patent No. 4,771,196, titled "Electronically variable active analog 
delay line" and issued to Mead and Lyon on September 13, 1988, describes an analog fiher 
bank cascade for signal processing. This patent, the disclosure of which is hereby 
incorporated by reference, illustrates an electronically variable active analog delay line that 
incorporates cascaded differential transconductance amplifiers with integrating capacitors and 
negative feedback from the output to the input of each noninverting amplifier. "Lyon's 
Cochlear Model", written in 1988 by Malcohn Slaney as Apple Technical Report #13, 
describes a digital filter bank cascade developed by Lyon as a model of the cochlea. Further 
details of the Lyon model may be seen by reference to the technical report, the disclosure of 
which is hereby incorporated by reference. 

This model uses a cascade of second-order filters, each of which requires a nimiber of 
computations every time the signal is sampled. Each filter has a set of coefficients associated 
with it, and must also store some previous computations. If the sampling rate is increased, or 
the number of filters is increased in order to increase resolution, the number of computations 
rises proportionally. Thus, the desire for better resolution and sampling of the acoustic signal 
is balanced against the computations required and the storage needed for each filter, A more 
efficient approach, such as the approach of the present invention, would reduce the 
computation required for the cascade and allow for a higher quality representation of the 
signal. 

This problem is not limited to digitized signals represented by discrete amplitude 
levels, nor is it limited to acoustic signals. Rather, it applies to any sampled signal 
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(represented by discrete time values). Although the disclosure herein describes the problem 
and the invention in the context of audio signal processing, one skilled in the art will 
recognize that the invention may be applied to any signal processing using sampling, 
including electrical waveform sampling and video signal processing. 
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SUMMARY OF THE INVENTION 



It should be appreciated that the present invention can be implemented in numerous 
ways, including as a process, an apparatus, a system, a device, a method, or a computer 
readable medium such as a computer readable storage medium or a computer network 
wherein program instructions are sent over optical or electronic communication links. 
Several inventive embodiments of the present invention are described below. 

Briefly, therefore, this invention provides for a method, article of manufacture, and 
apparatus for real-time processing of signals. In an embodiment of the invention, a system 
for processing audio signals comprises a sequence of digital filters each configured to process 
a selected frequency using a set of coefficients. A filter configured to process a certain 
frequency shares its coefficients with another filter that processes a frequency that is lower 
than the first frequency by at least one frequency interval, such as an octave. The first filter 
samples at a certain sampling rate, and the second filter's sampling rate is determined by 
multiplying the first sampling rate by the ratio of the second frequency to the first frequency. 
The filters are evenly grouped into frequency intervals, such as octaves. Filters in an octave 
are sampled at a sampling frequency that is at least twice as high as the highest frequency 
processed in that octave. 

The advantages and further details of the present invention will become apparent to 
one skilled in the art from the following detailed description when taken in conjunction with 
the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The present invention will be readily understood by the following detailed description 
in conjunction with the accompanying drawings, wherein like reference numerals designate 
like structural elements, and in which: 

FIG. 1 is a sectional view of the irmer and outer ear of a human ear; 

FIG. 2 is a sectional view of the inner ear of a human ear; 

FIG. 3 is a schematic of a signal processing system in accordance with the invention; 

FIG. 4 depicts the structure of the cochlear model in a serial filter bank cascade 
configuration in accordance with the invention; 

FIG. 5 is a signal flow graph of a filter equation in accordance with the invention; and 

FIG. 6 is a schematic of the filter bank cascade showing its division into octaves and 
the use of downsampling. 
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DESCRIPTION OF THE INVENTION 



Overview 

A signal processing system in accordance with the invention comprises a computer 
configured with a cascade of digital filters arranged sequentially on a logarithmic frequency 
scale, through which a signal is passed. The filters are configured to process certain 
frequencies and are programmed with filter coefficients appropriate to the desired filter 
behaviors and frequencies processed. Each successive filter in the sequence is configured to 
process a lower frequency than the one before it. Each filter also has a tap associated with it 
for extracting the filter output, and the number of filters and taps is determined by the desired 
resolution and frequency range. The filters are grouped into octaves, and within an octave 
group, a sampling rate is used that meets the Nyquist sampling criterion for the highest 
frequency filter in the octave. The filters in the highest octave use the same filter coefficients 
as filters in the lower octaves, with each successively lower octave group using a 
successively lower sampling rate to produce the lower frequency filters. Since the filters in 
each octave group remove the highest frequencies in the signal, the sampling rate can be 
reduced between octaves without violating the Nyquist sampling criterion. 

In another embodiment of the invention, a filter can be used to process a certain 
frequency at a certain sampling rate and reused to process other frequencies that are one, two, 
or more octaves higher or lower, with a corresponding adjustment to the sampling frequency 
based on the highest frequency in the octave of target frequency. Another filter can be used 
to process another frequency in the same octave, and be reused to process other frequencies 
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that are one, two, or more octaves higher or lower. Li this manner, an array of filters 
covering a single octave can be used to process signals spanning multiple octaves. 

In a further embodiment of the invention, the efficient digital filter bank cascade can 
be used as a model of a cochlea to process acoustic signals with improved accuracy and 
resolution, and more efficient use of computational and storage resources. 

The response of this cascade of digital filters is thus computed in an efficient manner 
that provides for high resolution while reducing computational expense and storage 
requirements. 

A detailed description of a preferred embodiment of the invention is provided below. 
While the invention is described in conjunction with that preferred embodiment, it should be 
understood that the invention is not limited to any one embodiment. On the contrary, the 
scope of the invention is limited only by the appended claims and the invention encompasses 
numerous alternatives, modifications, and equivalents. For the purpose of example, 
numerous specific details are set forth in the following description in order to provide a 
thorough understanding of the present invention. The present invention may be practiced 
according to the claims without some or all of these specific details. For the purpose of 
clarity, technical material that is known in the technical fields related to the invention has not 
been described in detail so that the present invention is not unnecessarily obscured. 



Attorney Docket No, rNTlP208 



8 



Detailed Description 

In accordance with the invention, a signal processing system comprises a computer 
configured to analyze signals, such as acoustic or audio signals. In an embodiment of the 
invention, the signal processing system is in the form of a software program being executed 
on a general-purpose computer such as an Intel Pentium-based PC running a Windows or 
Linux operating system, or a workstation running Unix. Other means of implementing the 
signal processing system may be used, such as a special-purpose hardwired system with 
instructions bumed into a chip such as an application specific integrated circuit (ASIC) or 
field-programmable gate array (FPGA). As is usual in the industry, the computer (CPU) 10 
may have memory 12, a display 14, a keyboard 16, a mass storage device 18, a network 
interface 20, and other input or output devices 22, shown in FIG. 3, Also shown in FIG. 3 is 
a signal input device 24 in the form of a microphone, though other types of signal input 
devices may be used. In accordance with common practice, the memory 12 and the mass 
storage device 18 can be used to store program instructions and data. The computer may 
fiirther have more than one central processing unit, such as a multiprocessor Pentium-based 
system or Sun SPARCstation. 

It will be readily apparent to one skilled in the art that more than one computer may 
be used, such as by using multiple computers in a parallel or load-sharing arrangement or 
distributing tasks across multiple computer such that, as a whole, they perform the fimctions 
of the signal processing system; i.e. they take the place of a single computer. It is intended 
that the disclosure cover all such configurations as if fiiUy set forth herein. 
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A signal processing system in accordance with the invention comprises a computer 
configured with program describing a cascade of digital filters arranged sequentially on a 
logarithmic fi-equency scale, through which a signal is passed. The filters are configured to 
process certain fi-equencies and are programmed with filter coefficients appropriate to the 
desired filter behaviors and fi'equencies processed. Each successive filter in the sequence is 
configured to process a lower fi-equency than the one before it. Each filter also has a tap 
associated with it, and the number of filters and taps is determined by the desired resolution 
and fi-equency range. A filter is used to process a signal of a certain fi-equency at a certain 
sampling rate, and shares its filter coefficients with filters configured to process signals of 
frequencies that are one, two, or more octaves lower. The filter also attenuates its target 
frequency and passes the signal on to the next filter in the sequence. For each successive 
filter in the sequence, the sampling rate may be reduced in proportion to the reduction in its 
target frequency. For convenience, the filters may be grouped into octaves, and each filter in 
an octave will be sampled at a rate that meets the Nyquist sampling criterion for the highest 
frequency filter in the octave. Lower octaves will be sampled at successively lower rates. 

In another embodiment of the invention, a filter can be used to process a certain 
frequency at a certain sampling rate and reused to process other frequencies that are one, two, 
or more octaves higher or lower, with a corresponding adjustment to the sampling frequency 
based on the target frequency, in accordance with the Nyquist sampling criterion. Another 
filter can be used to process another frequency in the same octave, and be reused to process 
other frequencies that are one, two, or more octaves higher or lower. In this manner, an array 
of filters covering a single octave can be used to process signals spanning multiple octaves. 
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Similarly to the above embodiment, the sampling rate can be reduced as the octave of 
frequencies being sampled is lowered. 

The invention will be illustrated by its use in audio signal processing, utilizing a 
model of the cochlea. This model describes the propagation of sound in the inner ear and the 
conversion of acoustic signals into neural signals. It combines a series of filters that model 
the traveling pressure waves with half-wave rectifiers to detect the energy in the signal and 
several stages of automatic gain control, as shown in FIG. 4. Sound pressure waves cause 
displacement of the hair cells and generation of neural signals as described above. This is 
modeled by the filters, which, like the hair cells, are tuned to specific frequencies. The 
basilar membrane is attuned to high frequency sounds near the base of the cochlea, where the 
sound enters, and senses progressively lower and lower frequencies as the sound pressure 
wave travels through the cochlea. The filters in the model are arranged similarly, with each 
filter attuned to a higher frequency than succeeding filters, so that the signal is gradually low- 
pass filtered. 

In this model, the audio signal acquired from the signal input device 24 undergoes 
some preprocessing, and is then passed through a cascade of sequentially arranged filters 30 
to model the propagation of the sound pressure waves through the cochlea, from left to right 
in the diagram of FIG. 4. Each filter 30 in the cascade has an output that feeds into the input 
of the next filter 30 in the cascade (if one is present), and a tap that allows data to be 
extracted from the filter 30, which in this embodiment is the data provided to the filter output. 
The tap has several stages of processing associated with it, such as a half-wave rectifier 32 ^ 
and automatic gain control 34. Each filter is attuned to a particular frequency, and has a set 
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of coefficients (ao, ai, a2, bi, b2) associated with it. The output of each fiher is calculated 
according to the following function: 

Equation 1. yn = aox„ + aiXn-i + ^i^n-i - biyn-i - b2yn-2 

where the filter output yn is a fiinction of the input data x„ at time n, previous inputs Xn-i and 
Xn-2, and previous outputs yn-i and yn-2. This formula is illustrated by the signal flow graph in 
FIG. 5. The output of the filter yn is passed to the input Xn of the next filter in the cascade. 

The filter response H(z) is given by the following: 

ao + aiz"^ + a2z'^ 

Equation 2, H(z) = 

1 + biz"^ + b2z"^ 

and 

2=:e'*(co/cDs)^ a) = 27if, a)s = 27cfs 
where fs is the sampling frequency. 

Substitution of the above into the transfer fimction of Equation 2 produces a filter response 
H(f), which is a fimction of the filter coefficients ao, ai, a2, bi, b2 and the sampling rate fs. 
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In this audio signal processing embodiment, the frequency range typically used is 20 
Hz to 20 kHz, since that is roughly the range of human hearing. With about 4,000 inner hair 
cells, a human has the equivalent of 4,000 taps spread over ten octaves, or about 400 taps per 
octave. 

The Nyquist Theorem states that when an analog waveform is digitized, only the 
frequencies in the waveform below half the sampling frequency will be recorded. In order to 
accurately represent the original waveform, sufficient samples must be recorded to capture 
the peaks and troughs of the original waveform. If a waveform is sampled at less than its 
Nyquist frequency (which is twice the frequency of the waveform), the reconstructed 
waveform will represent low frequencies not present in the original signal. This phenomenon 
is called "aliasing", and the high frequencies are said to be "under an alias". 

Thus, since the highest frequency is 20 kHz, the Nyquist frequency is 40 kHz. The 
standard sampling rate for CD (compact disc) audio is slightly higher, at 44.1 kHz. A brute 
force approach would be to represent all 4,000 inner hair cells as 4,000 filters. Equation 1 
shows that there are five multiplication operations and four addition operations per filter per 
sample, for a total of nine operations per filter sample. Thus, a complete representation of a 
himian ear would require 

44,100 * 4,000 * 9 = 1,587,600,000 operations per second 
Such a large nimiber of operations would make computation of the cochlear model 
impractical on all but the fastest computers. Digital signal processing chips typically have a 
multiply-accumulate instruction, and can perform one addition and multiplication as a single 
unit of computation. The nimiber of computations required for a DSP to compute the formula 
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of Equation 1 would drop to five, lowering the requirement to 882,000,000 operations per 
second. This is still impractical. Typically, the number of filters is reduced to a much more 
manageable size, on the order of 125 filters total, covering six octaves, with a sample rate of 
16 kHz. Computation of this model requires 

16,000 * 125 * 9 = 18,000,000 operations per second 
In a DSP, this would be 10,000,000 operations per second. The number of computations 
required is about two orders of magnitude smaller, but significant degradation of the sampled 
waveform has taken place. The fi-equency range has been reduced by four octaves, and the 
filter density within the range covered is lower, which reduces the resolution. Further, with 
the sampling fi*equency reduced to 16 kHz, the maximum frequency that can accurately be 
represented by the sampled waveform is now 8 kHz. 

Increasing the number of filters to 600 and covering 10 octaves, as well as increasing 
the sampling frequency to 44.1 kHz results in significant improvement in resolution, and the 
frequency range covered now more closely approximates that of human hearing. This would 
require 

44,100 * 600 * 9 = 238,140,000 operations per second 
or 132,300,000 operations per second in a DSP. This is better than the original number for a 
complete model, but is still very computationally expensive. 

In accordance with the invention, the filters are evenly distributed over the octaves, 
resulting in 60 filters per octave. In one embodiment, 60 objects are created in a computer. 
Each object has a set of coefficients as described above, and additionally has ten sets of state 
variables, corresponding to ten filters running at frequencies that are whole octaves apart. 
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The 60 objects using their first sets of state variables correspond to the first octave group of 
filters, while the 60 objects using their second sets of state variables (and sampling at a lower 
fi-equency) correspond to the second octave group of filters, and so on. In another 
embodiment, each object contains a set of coefficients, but only one set of state variables, and 
is run at a single frequency. In this case, 600 objects are required to represent 600 filters. 

The filters in the first octave are tuned to the fi-equencies in the highest octave, 20 kHz 
to 10 kHz, and are sampled at 44.1 kHz, which satisfies the Nyquist sampling criterion. The 
filters in the second octave are tuned to half of the frequencies of the corresponding filters in 
the first octave, and range from 10 kHz to 5 kHz. These filters in the second octave are 
sampled at 22.05 kHz, half of the first sampling frequency. Coefficients for each filter are 
stored in memory and applied in the computations for the filters. As the audio signal is 
passed through each filter, the signal is sampled and fihered before being passed to the next 
fiher. FIG. 6 shows the arrangement of the fiUers. At the end of the first octave, the signal is 
passed into the first filter in the next octave, which comprises filters sampling at half the 
sampling rate of the first octave, as stated above. Successive octaves are downsampled in a 
similar manner. The computational requirement for the digital filter bank of the invention 
would be 

44,100 * 60 * 9 * (1 + V2 + V4 + Vg + V16 + V32 + V64 + Vi28 + V256 + V512) = 
47,581,488 operations per second, or 26,434,160 operations per second in a DSP. Thus, 
downsampling each successive octave has resulted in a fivefold reduction in computational 
requirements. This is a nontrivial improvement, particularly in the area of embedded signal 
processing chips, where performance, size, and cost are primary considerations. 
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For a given set of filter parameters (ao, ai, a2, bi, b2) at a particular sampling rate fs, 
the second-order filter will have some resonant fi-equency ff. If the filter parameters are kept 
constant while the sampling rate fs is divided by two, the resonant fi-equency fr will also be 
divided by two, because the transfer fimction depends on 2, which is a normahzed fi-equency 
variable; i.e. it is normalized by the sampling rate fs. Thus, scaling the sampling fi-equency 
scales the fi-equency response of the filter by the same amount. In this maimer, the filter can 
be timed to a frequency that is an octave lower, by sampling at half the original sampling rate 
without changing the filter coefficients. Downsampling again in this manner produces a filter 
that runs at yet another octave lower, so long as high fi-equencies are filtered out before 
downsampling. The sampling fi-equency does not necessarily have to be divided by two, 
four, or other multiples of two, nor do the filter fi-equencies have to be grouped by octaves. 
Any scaling factor may be used, such as ten (resulting in shifts by decades rather than 
octaves) or other number (resulting in shifts by a corresponding interval on a logarithmic 
scale), which does not have to be a whole number. 

Thus, in the configuration depicted in FIG. 6, any given filter shares filter parameters 
with filters that are one, two, or more octaves higher or lower. For example, the highest 
frequency filter 40 in the first octave shares filter coefficients with the highest frequency filter 
50 in the second octave, the highest frequency filter 60 in the third octave, and so on. The 
second-highest frequency filter 42 in the first octave shares filter coefficients with the 
second-highest frequency filters 52 and 62 in the second and third octaves, and with all other 
corresponding filters (tuned to frequencies that are one, two, or more octaves lower). It will 
be apparent that "corresponding" refers to filters that occupy the same relative positions in 
their respective octaves. 
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In effect, the filters 40, 50, 60, and other filters in corresponding positions in other 
octaves are the same filter. Similarly, filters 42, 52, 62, and corresponding filters are the 
same filter, as are all groups of filters that differ in fi-equency by whole octaves. A single 
filter can be used to sample a target fi-equency, and other target fi-equencies that are one, two, 
or more octaves lower, with reduction of the sampling fi-equency as described above, as long 
as the Nyquist criterion of removing higher fi-equencies is observed. 

This reduces storage requirements for filter coefficients, because only one set of filter 
coefficients (for one octave) needs to be stored. Successive octaves may reuse the filter 
coefficients in accordance with the invention. Another advantage of the invention is that the 
required precision for filter coefficients is lower, and thus, fewer bits are required to represent 
each coefficient. In the prior art approach, 20 bits were required for acceptable results, 
particularly for the low-fi-equency filter coefficients. The inventive digital filter bank cascade 
requires about 12 bits to maintain an acceptable level of stability. 

The advantage of reducing precision of the filter coefficients is not limited to storage. 
The reduced number of bits in the operands means that the processing hardware can be made 
smaller. For example, the arithmetic logic unit can be made smaller, since it does not need to 
process as many bits, and buses can be made narrower. Further advantages of reduced 
precision requirements will be readily apparent to one skilled in the art, as will other 
advantages of the invention. 
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The foregoing disclosure and embodiment demonstrate the utility of the present 
invention in dramatically increasing the efficiency of computing digital filter bank cascades 
for purposes such as audio signal processing, although it will be apparent that the present 
invention will be beneficial for many other uses. 

All references cited herein are intended to be incorporated by reference. Although the 
present invention has been described above in terms of specific embodiments, it is anticipated 
that alterations and modifications to this invention will no doubt become apparent to those 
skilled in the art and may be practiced within the scope and equivalents of the appended 
claims. For example, one skilled in the art will recognize that the filters do not necessarily 
need to be evenly distributed over the octaves, or that the filters do not necessarily need to be 
used with an audio signal. The present embodiments are to be considered as illustrative and 
not restrictive, and the invention is not to be limited to the details given herein. It is therefore 
intended that the following claims be interpreted as covering all such alterations and 
modifications as fall within the true spirit and scope of the invention. 
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